Food inventory system and method

ABSTRACT

A food inventory device having a bar code scanner and camera to add and remove inventory items to and from the inventory. The scanner may be mounted on an inventory storage container to facilitate inventory control from one or more storage devices, including refrigerators, freezers, and pantries. The inventory system may display a table listing the inventory items along with variable details. Based on the food inventory list, the inventory system may suggest recipes, display the ingredients in stock for suggested recipes, and create a shopping list of the ingredients not in stock for a desired recipe. The device may have an ordering system allowing users to order items in the storage device that have been exhausted or otherwise need to be replenished through audio or touch input. The ordering system may be connected to third-party external sites and may be based on one or more user profile settings.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation in part which claims priority to U.S.Non-Provisional application Ser. No. 15/005,891 filed on Jan. 25, 2016,which is incorporated by reference in its entirety.

FIELD OF THE DISCLOSURE

This disclosure relates generally to the field of methods and systemsfor inventory management of foods, beverages, or other items which arecommonly stored and consumed in a household.

BACKGROUND

A refrigerator is a standard appliance found in almost every modernhome. The technology discussed below falls into the category ofinventory management of foods, beverages, or other items which arecommonly stored in a household.

For many households, especially families or those with multiple adultsliving in the same home, the refrigerator, freezer, and pantry can getdisorganized and overfull making it hard to know what exactly is or isnot in the refrigerator, freezer, or pantry. When people don't know whatfood items they have, it can lead to people accidentally purchasingduplicate items, forgetting about items on a shopping list or recipe, orallowing perishable foods to rot and become waste.

There have been attempts at solving this food inventory managementproblem. However, many current attempts are overly complicated and tooexpensive to install for the majority of homeowners. Other attempts puttoo much of a time burden on users, so that it becomes inconvenient tomanage the food inventory and users lose motivation to keep up with thesystem. Still others have no way to communicate to users the inventorywhen they are not at home and are at the store.

SUMMARY

The present invention is directed to a food inventory system comprisingone or more databases, the databases stored in a memory, wherein atleast one database is an inventory database, the inventory databasecomprising one or more inventory items placed in a storage container,one or more processors coupled to the one or more databases, and atleast one computing device coupled to the one or more processors and theone or more databases; wherein the one or more processors are configuredto: updating the inventory database with the one or more inventory itemsby capturing identifying information of the inventory items being placedin the storage container, updating the inventory database by capturingidentifying information of the one or more inventory items being removedfrom the storage container, and presenting a user interface on thecomputing device, wherein the user interface comprises a display of alisting of the one or more inventory items in the storage container fromthe inventory database along with variable details; the one or moreinventory items in the storage container, the one or more inventoryitems sortable by details, comprising storage date, category type, nameof the one or more inventory items in the storage container, number ofdays the one or more inventory items in the storage container werestored in the storage container, expiration date of the one or moreinventory items in the storage container, and quantity of the one ormore inventory items in the storage container, the food inventory systemfurther comprising a bar code reader, the bar code reader configured tocapture identifying information of the one or more inventory items,wherein the identifying information of the one or more inventory itemsis searched in a barcode database stored in the memory or through abarcode database API over the internet to recognize the one or moreinventory items, the food system further comprising a camera having acamera lens, the camera configured to capture identifying information ofthe one or more inventory items, wherein the identifying information ofthe one or more inventory items is searched using an image recognitionAPI stored in the memory to recognize the one or more inventory itemswhose identifying information has been captured by the camera, the foodinventory system further comprising a camera sensor configured to sensethe one or more inventory items placed within a predetermined range ofthe camera, the camera sensor configured to activate the camera lenswhen the one or more inventory items are located within range of thecamera, wherein the camera sensors when activated captures identifyinginformation of the one or more inventory items in range, the foodinventory system further comprising a mounting bracket, the mountingbracket configured to couple the storage container to the computingdevice, the mounting bracket configured to allow the computing device toslide in and out of the mounting bracket, the mounting bracket furthercomprising one or more holes in the mounting bracket configured to allowthe camera lens on the computing device to see through and take imagesof inventory items and to allow the camera sensor on computing device tosee through and sense the one or more inventory items, the foodinventory system further comprising a microphone, wherein the one ormore processors are further configured to: receiving and process soundinto electrical signals; and updating the inventory database in responseto the electrical signals, the food inventory system further comprisinga speaker, wherein the one or more processors are further configured to:receive and process electric signals into sound, notifying the userthrough speaker in response to user input or event, wherein theprocessors are further configured to: order inventory items when anaction occurs, wherein the processors are further configured to: orderinventory items when user inputs a request to order inventory items,wherein the processors are further configured to: order inventory itemswherein the percentage of a particular inventory item located in storagecontainer drops below a predetermined percentage, wherein the processorsare further configured to: order inventory items wherein the percentageof a particular inventory item located in storage container drops belowa predetermined percentage of the overall amount of the particularinventory item stored of a predetermined amount of time, wherein theprocessors are further configured to: uploading a user profile in thedatabases, the user profile used to analyze when to order the inventoryitems.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present disclosure are described in detail below withreference to the following drawings. These and other features, aspects,and advantages of the present disclosure will become better understoodwith regard to the following description, appended claims, andaccompanying drawings. The drawings described herein are forillustrative purposes only of selected embodiments and not all possibleimplementations and are not intended to limit the scope of the presentdisclosure. Also, the drawings included herein are considered by theapplicant to be informal.

FIG. 1 is an embodiment of the front panel of the electronic device.

FIG. 2 is an embodiment of the mounting bracket for the electronicdevice.

FIG. 3 is an embodiment of the charging station for the electronicdevice.

FIG. 4 is a top-view embodiment of the charging station for theelectronic device.

FIG. 5 is an embodiment of sub-screens for entering food items in theinventory system by scanner.

FIG. 6 is an embodiment of additional sub-screens for entering fooditems in the inventory system by scanner.

FIG. 7 is an embodiment of sub-screens for entering food items in theinventory system by camera.

FIG. 8 is an embodiment of additional sub-screens for entering fooditems in the inventory system by camera.

FIG. 9 is an embodiment of sub-screens for removing food items from theinventory system by scanner.

FIG. 10 is an embodiment of a sub-screen for viewing the list of itemsin the inventory system.

FIG. 11 is an embodiment of a sub-screen for editing the details of anitem in the inventory system.

FIG. 12 is an embodiment of a sub-screen for recipe suggestions andcreating shopping lists.

FIG. 13 is an embodiment of a sub-screen for a calendar with memocapability.

FIG. 14 is an embodiment of a sub-screen for a calendar memo.

DEFINITIONS

“Food-In”: a main menu option on the main screen to enter items into theinventory system.

“Food-Out”: a main menu option on the main screen to remove items fromthe inventory system.

“Main”: a sub-screen option to bring the screen on the device to themain menu.

“Today's Recipe”: a main menu option on the main screen to obtain recipesuggestions based on ingredients in the inventory system.

“Use Camera”: a sub-screen option to initiate the process of taking animage of an item.

“Use Scanner”: a sub-screen option to initiate the process of scanningan item.

“What's Inside?”: a main menu option on the main screen to view theinventory list.

DETAILED DESCRIPTION

In the Summary above and in this Detailed Description, and the claimsbelow, and in the accompanying drawings, reference is made to particularfeatures of the invention. It is to be understood that the disclosure ofthe invention in this specification includes all possible combinationsof such particular features. For example, where a particular feature isdisclosed in the context of a particular aspect or embodiment of theinvention, or a particular claim, that feature can also be used, to theextent possible, in combination with and/or in the context of otherparticular aspects and embodiments of the invention, and in theinvention generally.

Where reference is made herein to a method comprising two or moredefined steps, the defined steps can be carried out in any order orsimultaneously (except where the context excludes that possibility), andthe method can include one or more other steps which are carried outbefore any of the defined steps, between two of the defined steps, orafter all the defined steps (except where the context excludes thatpossibility).

“Exemplary” is used herein to mean “serving as an example, instance, orillustration.” Any aspect described in this document as “exemplary” isnot necessarily to be construed as preferred or advantageous over otheraspects

Throughout the drawings, like reference characters are used to designatelike elements. As used herein, the term “coupled” or “coupling” mayindicate a connection. The connection may be a direct or an indirectconnection between one or more items. Further, the term “set” as usedherein may denote one or more of any item, so a “set of items,” mayindicate the presence of only one item, or may indicate more items.Thus, the term “set” may be equivalent to “one or more” as used herein.

In the following detailed description, numerous specific details are setforth in order to provide a more thorough understanding of the one ormore embodiments described herein. However, it will be apparent to oneof ordinary skill in the art that the invention may be practiced withoutthese specific details. In other instances, well-known features have notbeen described in detail to avoid unnecessarily complicating thedescription.

The present disclosure is generally drawn, inter alia, to systems,apparatus, and methods therein relating to inventory management offoods, beverages, or other items which are commonly stored and consumedin a household. In the preferred embodiments, a portable device withcustomized software installed enables users to manage inventory of fooditems in multiple locations by barcode, image, and manual entries.

The present invention is an electronic device with customized softwareinstalled, which can be mounted directly on the door of a refrigeratoror on the wall. The device keeps track of food items that go in and outof the refrigerator, multiple fridges, freezers, or pantry by capturingeither the bar-code on the food item or the images of the food item.

The device may be connected to the home wireless internet (Wi-Fi) sothat its inventory information can be communicated and accessed by smartphones, laptops, and other internet connected device remotely.

Because the user can access the food inventory status from the device,the user can make an informed decision on purchasing food items.Redundant food purchases and unnecessary trips to the grocery can beavoided when the device shows exactly what is in the refrigerator.

The device may suggest recipes based on what is in the refrigerator andthe time of the day so that the user can better consume food items inone's refrigerator and avoid forgetting them and letting them expire andgo to waste. For example, breakfast recipes may be presented in themorning time. The device may suggest recipes when all of the ingredientsare present in the inventory system. Alternatively, the device maysuggest recipes when some of the ingredients are present in theinventory system and optionally create a shopping list for theingredients that are not in the inventory system.

In addition, the user can search specific recipes based on the categoryon the device software. Once the user chooses a specific recipe, thedevice software may show what food ingredients are in the refrigeratorand what food ingredients are missing. In addition, the device maycreate a shopping list based on what is needed for the recipe. Theshopping list may be shared across multiple users. In some examples, theuser may desire to check off the list when the ingredients on theshopping list were purchased.

In addition, the user can make a grocery shopping plan by utilizing acalendar function in the device. The calendar function offers memocapability for the user and can be shared across multiple users.

The overall idea is to save money on the food that may have been wastedin the refrigerator, save time by reducing the number of grocery trips,and having fun times cooking in the kitchen by following recipes thatare customized by what is in the refrigerator.

In some embodiments, the device has a touch screen on the front facingthe user and several components integrated perform food inventorymanagement. Users may access a user interface through image recognitionapplication program interface (API). User interface may have a pluralityof buttons or icons that are selectable by user to perform particularprocesses in response to the selections The device is operated by customsoftware and the power is supplied by an internal, rechargeable battery.The battery may be charged by plugging the device into a chargingstation.

In some embodiments, the device may be configured to manage inventory inmultiple locations, such as multiple refrigerators, freezers, andpantry.

FIG. 1 is an embodiment of the front panel of electronic device 100.FIG. 1 includes a hard cover case 101, a charging slot 102, a screen103, a bar code reader 104, a bar code scanner window 105, a camera lens106, a camera sensor 107, a graphic calendar icon 108, a brand name andlogo 109, a date and clock time 110, a graphic “Food-In” button 111, agraphic “Food-Out” button 112, a graphic “What's Inside” button 113, agraphic “Today's Recipe” button 114, and a graphic user settings button115. In FIG. 1, hard cover case 101 is preferably made out of hardmaterial like plastic to protect the device from damage. Charging slot102 is a slot for the universal serial bus (USB) pin in the chargingstation, shown in FIGS. 3 and 4, to charge the device and updatesoftware.

In FIG. 1, screen 103 is a touch-screen made of glass, plastic, or othercommonly used touch-screen surface. Screen 103 may be back-lit by LCD,LED, Plasma, or other commonly used screen lighting technology. Screen103 may be attached to and removable from hard cover case 101. Bar codereader 104, located on the bottom left of the device, is a bar codereader component that may be angle adjustable by rotating the angle ofbar code scanner window 105. To the right of bar code reader 104 iscamera lens 106. Camera lens 106 may be used for capturing images offood to inventory food items. To the right of camera lens 106 is camerasensor 107. Camera sensor 107 senses items placed within camera range,preferably up to 10 inches away from camera sensor 107, and activatescamera lens 106 when an item in range is detected. The device uses barcode reader 104 and image recognition application program interface(API) to recognize food items when the user scans the item or cameralens 106 captures an image of the item before placing it in theinventory, such as a refrigerator or pantry. Speed of processing timecan vary based on dependent variables, such as the home Wi-Fi networkband speed, home internet connection speed, and bar code and imagerecognition speed. The device may download the bar code database of fooditems to reduce the overhead time of the internet speed. However,periodic database updates may be required.

In FIG. 1, the home screen preferably shows the brand name and logo 109at the top center of screen 103. Just below brand name and logo 109 isday and time 110, which displays the current day of the week and time.The home screen also shows one or more menu options, “Food-In” button111, “Food-Out” button 112, “What's Inside?” button 113, “Today'sRecipe” button 114, graphic calendar icon 108, and graphic user settingsbutton 115.

In FIG. 1, graphic “Food-In” button 111 is used to enter food items intothe inventory system. The graphic “Food-Out” button 112 is used toremove food items from the inventory system. The graphic “What'sInside?” button 113 is used to view a list of inventory items withvarious details. The graphic “Today's Recipe” button 114 is used to getrecipe suggestions based on the contents in the inventory system and tocreate shopping lists. Graphic calendar icon button 108 is used to enteror view memos for a specific calendar date. The home screen menu itemsare discussed in further detail in subsequent figures.

In FIG. 1, user settings button 115 allows a user to set a current time,connect to home Wi-Fi, turn off API service(s), adjust backlitbrightness, add users, and set administrative security password.

FIG. 2 is an embodiment of the mounting bracket for the electronicdevice. FIG. 2 includes a mounting bracket 201, a mounting pad 202, acamera lens hole 203, a camera sensor hole 204, and wall mounting holes205. In FIG. 2, mounting bracket 201 may be made of hard materialcomprising plastic and metal. Mounting bracket 201 may be attached to adoor of a refrigerator, a wall, or other hard surface where the devicemay be frequently accessed. Behind mounting bracket 201 is mounting pad202, which may be configured to be a sticky patch or magnet that mayadhere to a desired hard surface location and hold the weight capacityof at least five pounds. Alternatively, mounting pad 202 may beconfigured with a hook or some sort of hanging system to secure onto adesired location. In addition, mounting holes 205 located on the backpart of mounting bracket 201 may be used to attach mounting bracket 201to a surface with screws. The device may easily slide in and out ofmounting bracket 201 for easy access. Camera lens hole 203 is a hole inmounting bracket 201 to allow camera lens 106 on the device to seethrough and take images of food items. Camera sensor hole 204 is a holein mounting bracket 201 to allow camera sensor 107 on the device to seethrough and sense food items.

FIG. 3 is an embodiment of the charging station for the electronicdevice. FIG. 3 includes a back-board 301, a front-board 302, abase-board 303, a universal serial bus (USB) connector 304, a wallcharger 305, and a computing device 307. In FIG. 3 is a charging stationfor the device shown in FIG. 1. The charging station may be placed on atable or countertop near an outlet to charge the device. The device maybe operable while connected to the charging station. Back-board 301 maybe configured to allow the device to slide in to the charging stationand allow the device to lean against back-board 301 while charging.Front-board 302 assists in securing the device in place by covering someportion of the device. Base-board 303 may be configured to stabilize theentire charging station to be upright, including the device whilecharging. Base-board 303 may also be configured to prevent the chargingstation from falling backwards.

In FIG. 3, USB connector 304 is a serial port connection for chargingand updating software for the device. USB connector 304 may be directlyplugged into computing device 307 for software updates and rechargingthe internal battery. USB connector 304 may also be directly plugged into wall charger 305. Wall charger 305 may be configured to connect to aUSB connector on one side and an electrical outlet on another side. Wallcharger 305 may be configured to be a 120 volt or 240 volt outletcharger.

FIG. 4 is a top-view embodiment of the charging station for theelectronic device. FIG. 4 includes a back-board 301, a front-board 302,a base-board 303, a USB connector 304, an electrical plug 305, amulti-pin USB plug 306, and a computing device 307. In FIG. 4,back-board 301, front-board 302, base-board 303, USB connector 304, andelectrical plug 305 function as described above in FIG. 3. Multi-pin USBplug 306 plugs into charging slot 102 in FIG. 1 to charge the device andupdate software from computing device 307.

FIG. 5 is an embodiment of sub-screens for entering food items in theinventory system by scanner. FIG. 5 includes a graphic “Main” button501, a graphic “Use Scanner” button 502, a graphic “Use Camera” button503, a set of instructions 504, and a set of blinking ellipses 505. InFIG. 5, two sub-screens are shown. The sub-screen on the left appearswhen “Food-In” button 109 is selected. The sub-screen on the rightappears when “Use Scanner” button 502 is selected. Graphic “Main” button501 may be selected at any time to return to the main screen shown inFIG. 1. Set of instructions 504 instructs the user to scan a food itemby placing the item in front of the scanner. Blinking ellipses 505appears to indicate to the user that bar code scanner 104 has beenactivated and ready to scan an item. After a food item has been scanned,the software program in the device searches the Barcode Database torecognize the product. The device may be configured to search through adownloaded database within the device or it may search through a barcodedatabase API over the internet. After the device has scanned the itemand searched a barcode database, screens shown in FIG. 6 appear.

FIG. 6 is an embodiment of additional sub-screens for entering fooditems in the inventory system by scanner. FIG. 6 includes a graphic“Main” button 501, a graphic “Change” button 601, a graphic “Add” button602, a graphic text box 603, a graphic text box 604, a graphicalphanumeric keyboard 605, and a graphic “Done” button 606. In FIG. 6,additional sub-screens for entering food items in the inventory systemby scanner are shown. The two upper sub-screens are the two sub-screens,one or the other, that appear after the device has scanned an item andsearched a barcode database. The sub-screen on the left is shown whenthe scanned item is recognized and gives the user an opportunity to makechanges via graphic “Change” button 601. The sub-screen on the right isshown when the scanned item is not recognized and gives the user anopportunity to add the item manually via graphic “Add” button 602.Graphic “Main” button 501 may be selected at any time to return to themain screen shown in FIG. 1.

When the graphic “Change” button 601 or “Add” button 602 is selected,the sub-screen displayed on the bottom appears. This screen allows theuser to enter the food name in text box 603 and optionally theexpiration date in text box 604 by using alphanumeric keyboard 605. Whenthe graphic “Done” button 606, located on the bottom right is selected,the device saves the entered information in the device's database alongwith a time stamp and returns to the scanning screen shown in FIG. 5;the right sub-screen of the two shown. Graphic “Main” button 501 may beselected at any time to return to the main screen shown in FIG. 1.

FIG. 7 is an embodiment of sub-screens for entering food items in theinventory system by camera. FIG. 7 includes a graphic “Main” button 501,a graphic “Use Scanner” button 502, a graphic “Use Camera” button 503, agraphic picture box 701, and a graphic red box 702. In FIG. 7, twosub-screens are shown. The sub-screen on the left appears when “Food-In”button 109 is selected. The sub-screen on the right appears when “UseCamera” button 503 is selected. When the screen on the right appears,the device instructs the user to place the food item in front of thecamera and to adjust the location of the food so that the image thecamera captures in graphic picture box 701 fits within the graphic redbox 702. Once the image of the food item fully occupies the graphic redbox 702, an automatic count-down initiates and the camera captures animage. The device then uses software to recognize the food item by usingimage recognition API. The device may be configured to allow the user todisable the image recognition API to cut the additional recognitiontime, which prompts the device to simply put the image in the device'sdatabase with the time stamp. Graphic “Main” button 501 may be selectedat any time to return to the main screen shown in FIG. 1.

FIG. 8 is an embodiment of additional sub-screens for entering fooditems in the inventory system by camera. FIG. 8 includes a graphic“Main” button 501, a graphic “Change” button 601, a graphic “Add” button602, a graphic picture box 701, and a graphic red box 702. In FIG. 8,additional sub-screens for entering food items in the inventory systemby camera are shown. The two sub-screens are the two sub-screens, one orthe other, that appear after the device has captured an image of thefood item. The sub-screen on the left is shown when the image of theitem is recognized and gives the user an opportunity to make changes viagraphic “Change” button 601. Additionally, the user is prompted to placethe next food item in front of the camera and repeat the process toenter a food item into the inventory by camera. The sub-screen on theright is shown when the image of the item is not recognized and givesthe user an opportunity to add the item manually via graphic “Add”button 602. When the graphic “Change” button 601 or graphic “Add” button602 are selected, a sub-screen similar to the one in the bottom of FIG.6 appears and the information is inputted accordingly. Graphic “Main”button 501 may be selected at any time to return to the main screenshown in FIG. 1.

FIG. 9 is an embodiment of sub-screens for removing food items from theinventory system by scanner. FIG. 9 includes a graphic “Main” button501, a graphic “Use Scanner” button 502, a graphic “Manage Manually”button 901, a set of instructions 504, a set of blinking ellipses 505,and a set of instructions 902. The sub-screen on the upper left appearswhen “Food-Out” button 110 is selected. The sub-screen on the upperright appears when “Use Scanner” button 502 is selected. Graphic “Main”button 501 may be selected at any time to return to the main screenshown in FIG. 1. Set of instructions 504 instructs the user to scan afood item by placing the item in front of the scanner. Blinking ellipses505 appears to indicate to the user that bar code scanner 104 has beenactivated and ready to scan an item. After a food item has been scanned,the software program in the device searches the Barcode Database withinthe device to recognize the product. After the device has scanned theitem and searched the barcode database, one of the bottom twosub-screens appear.

The sub-screen on the bottom left appears if the item is recognized, thedevice deletes the item from its records, and prompts the user with thenext instruction 902 to scan the next item to remove from its inventorylist. The sub-screen on the bottom right appears if the item was notrecognized, nothing happens to the inventory list, and the user isprompted to scan the next item via instructions 902. Selecting thegraphic “Manage Manually” button 901 results in the same process asdescribed for selecting graphic “What's Inside?” button 113 shown on themain screen in FIG. 1. Graphic “Main” button 501 may be selected at anytime to return to the main screen shown in FIG. 1.

FIG. 10 is an embodiment of a sub-screen for viewing the list of itemsin the inventory system. FIG. 10 includes a graphic “Main” button 501, asorting arrow 1001, a check box 1002, a check box 1003, a check box1004, a check box 1005, a set of page numbers 1006, a graphic “Delete”button 1007, and a graphic “Edit” button 1008. In FIG. 10, thesub-screen shown appears when a user selects the graphic “What's Inside”button 113 on the main screen shown in FIG. 1. The sub-screen shows atable listing the inventory items along with variable details that maybe sorted by storage date by selecting sorting arrow 1001. Some of thedetails displayed include category type, name of the food item, numberof days the item was stored, the expiration date, and quantity of items.Page numbers 1006 allows the user to jump to different parts of theinventory list. Check box 1002 allows the user to select all of thecheck boxes in the “Delete” column for removal from the inventory list.Check box 1003 allows the user to select all of the check boxes in the“Edit” column for detail modification. Selecting graphic “Delete” button1007 removes the items with checked boxes from the inventory list.Selecting graphic “Edit” button 1008 allows the user to modify thedetails of the items with checked boxes. For example, to remove applesfrom the inventory list, check box 1004 would be checked and thengraphic “Delete” button 1007 would be selected to finalize removal ofapples from the inventory list. To modify the details for apples, checkbox 1005 would be checked and then graphic “Edit” button 1008 would beselected to edit the details, which is discussed in further detail inthe next figure.

FIG. 11 is an embodiment of a sub-screen for editing the details of anitem in the inventory system. FIG. 11 includes a graphic “Main” button501, a graphic picture box 701, a graphic red box 702, a graphic textbox 603, a graphic text box 604, a graphic alphanumeric keyboard 605, agraphic “Capture Image Now” button 1101, a graphic text box 1102, agraphic text box 1103, a graphic text box 1104, a drop-down arrow 1105,and a graphic “Save” button 1106. In FIG. 11, a sub-screen to modify thedetails of a food item is shown. Picture box 701 and red box 702 allowthe user to capture an image for the food item when graphic “CaptureImage Now” button 1101 is selected. The user may modify the food name intext box 603, the quantity of the food items in text box 1102, thenumber of days the food item has been stored in text box 1103, thecategory of the food item in text box 1104, and the expiration date ofthe food item in text box 604. For example, the category of the fooditem may be selected using drop-down arrow 1105 to select “Fruit” fortext box 1104. As another example, the quantity of the item may belowered by a value of one by using alphanumeric keyboard 605. Selectinggraphic “Save” button 1106 will save the data modified and entered.Graphic “Main” button 501 may be selected at any time to return to themain screen shown in FIG. 1.

FIG. 12 is an embodiment of a sub-screen for recipe suggestions andcreating shopping lists. FIG. 12 includes a graphic “Main” button 501, agraphic text box 1104, a drop-down arrow 1105, a graphic text box 1201,a graphic text box 1202, a graphic “Search” button 1203, a graphic“Other Suggestion” button 1204, a recipe table 1205, and a check box1206. In FIG. 12, the sub-screen shown appears when a user selects thegraphic “Today's Recipe” button 114 on the main screen shown in FIG. 1.The sub-screen shows a table listing suggested recipes based on theinventory list. The user may select search parameters such as time ofday in text box 1201 by selecting drop-down arrow 1105. Other searchparameters include category of recipe in text box 1104 and specificterms in text box 1202. Recipe ideas may be suggested by selectinggraphic “Other Suggestion” button 1204. Recipe table 1205 may beconfigured to show the recipe name, whether all of the ingredients arein stock, and the number of ingredients that are needed. A user mayselect a check box in the “Create Shopping List” column to generate ashopping list of items needed for a certain recipe. For example, a usermay desire to make “Cheesy Ham Scramble” and selects check box 1206 forthe two ingredients that are needed to follow the recipe. The softwaremay be configured to allow the user to do this with the device at homeor with mobile device software on the go or at the store. Graphic “Main”button 501 may be selected at any time to return to the main screenshown in FIG. 1.

FIG. 13 is an embodiment of a sub-screen for a calendar with memocapability. FIG. 13 includes a graphic “Main” button 501, a graphicleft-pointing triangle button 1301, a current month and year 1302, agraphic right-pointing triangle button 1303, a graphic star button 1304,and a graphic calendar box 1305. In FIG. 13, a user may select graphicleft-pointing triangle button 1301 to view a previous month. A user mayview the next month by selecting graphic right-pointing triangle button1303. Between the two graphic triangle images is displayed the currentmonth and year 1302 displayed on the sub-screen at the moment. A usermay select any calendar date box within the graphic calendar box to adda memo, such as graphic calendar box 1305. When a calendar box isselected, a sub-screen will be displayed as shown in FIG. 14. A calendardate box that has a memo will display graphic star button 1304, such ason calendar date boxes 17 and 22. Graphic “Main” button 501 may beselected at any time to return to the main screen shown in FIG. 1.

FIG. 14 is an embodiment of a sub-screen for a calendar memo. FIG. 14includes a graphic “Go back to Calendar” button 1401, a text box 1402, agraphic alphanumeric keyboard 605, a graphic “Delete Memo” button 1403,and a graphic “Save” button 1404. In FIG. 14, a sub-screen for enteringmemos for a specific date is shown after selecting a calendar box asdiscussed in FIG. 13. A user may type a memo using graphic alphanumerickeyboard 605, wherein the text would be configured to appear in text box1402. The memo in text box 1402 may be deleted by selecting graphic“Delete Memo” button 1403. The memo in text box 1402 may be saved byselecting graphic “Save” button 1404. A user may go back to the calendarby selecting graphic “Go back to Calendar” button 1401.

Electronic device 100 may have a connected speaker assembly thatconverts an electrical signal from control system into an audible soundthrough speaker 127 as illustrated in FIG. 1. The speaker assembly maybe mounted to the housing of electronic device 100 such that audiblesound from speaker 127 has access to the exterior of the housing ofelectronic device 100 where it then may be heard in the surroundingenvironment. The purpose of speaker 127 may be to allow the user toreceive an auditory signal audible messages from electronic device 100signifying a change in status or that an event has occurred wherebyelectronic device 100 notifies user of this change in event or status.In some embodiments speaker 127 may be connected to a microphone such asmicrophone 128 that allows for the passage of sound to receive auditorysignals from a person in proximity. Electronic device 100 may also havethe necessary circuitry to amplify and convert the signal to speaker 127and to convert the signal from microphone 128.

In one or more non-limiting embodiments image recognition applicationprogram interface (API) may have a digital assistant module operable toperform and implement various types of function, actions, and operationsfor electronic device 100 with input from microphone 128 and outputthrough speaker 127. Digital assistant module may be activated in thesettings or automatically enabled. Electronic device 100 may pick up thevoice of the household and family members and add/subtract/report theitems in the refrigerator/kitchen cabinets. Users of electronic device100 may audibly insert a statement or question through microphone 128and receive a response from digital assistant module that may be audiblypresented to user through speaker 127.

Digital assistant module may utilize speech to text whereby digitalassistant module generates a set of candidate text interpretations of anauditory signal such as the vocal commands from user. Digital assistantmodule may employ statistical language models to generate candidate textinterpretations of the auditory signals from user whereby digitalassistant module may analyze the text interpretations and transmit anotification in response. For example, when user places two carrots intothe refrigerator, instead of scanning the barcode or taking an imageshot in front of camera lens 106, user may say such as “I am putting in2 carrots into the refrigerator” and digital assistant module mayreceive the audio input and convert the audio input into text andanalyze the text to accordingly update device's database. In someembodiments, digital assistant module may provide an action wherebydigital assistant module may transmit a notification pertaining toacknowledgement of users audible input.

Users may assign a nickname to electronic device 100 through userinterface such as “Leah” such that digital assistant module analyzesfirst that user has said the assigned nickname and then analyzes theaudible inputs following the assigned nickname.

Users may assign a nickname a location of electronic device 100 throughuser interface such as “Freezer, Refrigerator, and the Pantry” or“Bathroom, Kitchen, Bedroom” such that digital assistant module analyzesfirst that user has said the assigned nickname a location of electronicdevice 100 and then analyzes the audible inputs following the assignednickname a location of electronic device 100 corresponding to thatlocation. This helps if user has multiple electronic devices 100 butonly the desired electronic device 100 analyzes the command.

User may say, “Leah”, I am putting in 2 carrots into the refrigerator”then digital assistant module automatically adds 2 carrots to theinventory database. The owner may not even say “refrigerator”, in thesentence. Digital assistant module may assume that the owner is puttingit into the refrigerator when the food item is sure to be in therefrigerator and transmit an audible alert through speaker that digitalassistant module cannot determine where the user would put a particularfood item, like raw chicken. Digital assistant module may provide anaction whereby digital assistant module may transmit a notificationasking the user the expiration date for the food item if the user didnot specify the expiration date. Digital assistant module may receivethe audio input from user and covert the audio input into text andanalyze the text to accordingly update device's database.

When taking out some food items from the refrigerator, user may say“Leah, I am taking out 2 eggs, 1 pack of bacon, and 2 carrots.” Digitalassistant module may receive the audio input from user and convert theaudio input into text and analyze the text to accordingly updatedevice's database. Then the device will take out those items from theinventory database.

The user may say, “Leah, make a list of food recipes that can be madeout of ingredients in the refrigerator.” Digital assistant module mayreceive the audio input from user and convert the audio input into textand analyze the text to accordingly update device's database. Digitalassistant module may then generate possible top 10 food recipes andtransmit a notification whereby the cooking steps may be displayed onthe screen to user.

There are other commands that may be utilized with the device. Forexample, user may say, “Leah, what are the items that are going to beexpired in 2 days?” Digital assistant module may receive the audio inputfrom user and covert the audio input into text and analyze the text toaccordingly update device's database. Digital assistant module maytransmit an audible alert through speaker 127 telling electronic device100 put the item names on transmitting a notification that is presentedon screen for display to user so that they may consume those items assoon as possible. User may also ask the device for already expired itemsso that the owner can purge out the items from the refrigerator/cabinetin a similar fashion.

In other embodiments, image recognition application program interface(API) may have an ordering module for a user requiring replenishment,replacement, or upgrade of items in the refrigerator or other storagelocation. User may register electronic device 100 through imagerecognition application program interface (API) with one or moresubscription programs so that electronic device 100 is associated with asubscription program to order one or more items from the subscriptionprogram. Users may also authorize subscription program access throughuser interface of image recognition application program interface (API)whereby when a subscription program is linked, access may be granted tovarious accounts of user and importing and exporting of data from thoseaccounts may occur.

For example, if a user is taking out the last milk carton or the eggcarton, databases may be updated whereby electronic device 100 maytransmit a notification either presenting information on the screen ordigital assistant module may audibly transmit a notification to the userasking if user wishes to order the same item through the subscriptionprogram. A user may also manually order one or more items by audiblytransmitting a request or through the user interface of screen onelectronic device 100.

To order more items, users may input their credit card or debit cardinformation for a credit card or debit card using any card known in theart, including, without limitation an ATM card, a VISA®, MasterCard®,Discover®, or American Express® card in a credit card input fieldthrough image recognition application program interface (API) orsubscription program, or can alternatively use PayPal® Squarepay® or thelike. Credit card and debit card information may be stored in databasessuch that they may be used again.

Ordering module may utilize demand-based ordering subsystems whereby thetype, amount, and how frequent items are consumed, thrown out, orordered by a user may be analyzed by image recognition applicationprogram interface (API). User interface of image recognition applicationprogram interface (API) or connected subscription platforms may provideoptions for users to opt into demand-based ordering whereby items may beordered at a predetermined time when an action occurs. Actions may beany number of occurrences such as when the amount of items reaches ordrops below a certain threshold percentage when divided by the overallitems originally stored in refrigerator over a period of time or at asingle time (for instance <20%).

Ordering module may also determine appropriate actions for special typesof users, such as to determine rate of consumption or necessaryrequirements of certain items based upon the information generated bythe user whereby user may initially register a profile associated withimage recognition application program interface (API). User may insertinformation pertaining to but not limited to age, location, height,weight, BMI, and dietary restrictions. The profile information may alterthe occurrence of actions to provide a more personalized demand basedordering system. For instance, if user has a high BMI, unhealthy itemsmay be ordered to be delivered after a predetermined time, at adecreased rate, or after BMI has returned to a predetermined range.

While preferred and alternate embodiments have been illustrated anddescribed, as noted above, many changes can be made without departingfrom the spirit and scope of the Food Inventory Device. Accordingly, thescope of the Food Inventory Device is not limited by the disclosure ofthese preferred and alternate embodiments. Instead, the scope of theFood Inventory Device should be determined entirely by reference to theclaims. Insofar as the description above and the accompanying drawings(if any) disclose any additional subject matter that is not within thescope of the claims below, the inventions are not dedicated to thepublic and Applicant hereby reserves the right to file one or moreapplications to claim such additional inventions. The reader's attentionis directed to all papers and documents which are filed concurrentlywith this specification and which are open to public inspection withthis specification, and the contents of all such papers and documentsare incorporated herein by reference.

The foregoing description of the invention has been presented forpurposes of illustration and description and is not intended to beexhaustive or to limit the invention to the precise form disclosed. Manymodifications and variations are possible in light of the aboveteaching. The embodiments were chosen and described to best explain theprinciples of the invention and its practical application to therebyenable others skilled in the art to best use the invention in variousembodiments and with various modifications suited to the usecontemplated. All the features disclosed in this specification(including any accompanying claims, abstract, and drawings) may bereplaced by alternative features serving the same, equivalent or similarpurpose, unless expressly stated otherwise. Thus, unless expresslystated otherwise, each feature disclosed is one example of a genericseries of equivalent or similar features. Any element in a claim thatdoes not explicitly state “means for” performing a specified function,or “step for” performing a specific function is not to be interpreted asa “means” or “step” clause as specified in 35. U.S.C. § 112 ¶6. Inparticular, the use of “step of” in the claims herein is not intended toinvoke the provisions of U.S.C. § 112 ¶116.

What is claimed is:
 1. A food inventory system comprising: one or moredatabases, the one or more databases stored in a memory, wherein atleast one database is an inventory database, the inventory databasecomprising one or more inventory items placed in a storage container;one or more processors coupled to the one or more databases; a camerahaving a camera lens, the camera configured to capture identifyinginformation of the one or more inventory items, wherein the identifyinginformation of the one or more inventory items is searched using animage recognition API stored in the memory to recognize the one or moreinventory items whose identifying information has been captured by thecamera; and a computing device coupled to the one or more processors andthe one or more databases; wherein the one or more processors areconfigured to: updating the inventory database with the one or moreinventory items by capturing the identifying information of the one ormore inventory items being placed in the storage container; updating theinventory database by capturing the identifying information of the oneor more inventory items being removed from the storage container;presenting a user interface on the computing device, wherein the userinterface comprises a display of a listing of the one or more inventoryitems in the storage container from the inventory database along withvariable details; the one or more inventory items in the storagecontainer sortable by details comprising storage date, category type,name of the one or more inventory items in the storage container, numberof days the one or more inventory items in the storage container werestored in the storage container, expiration date of the one or moreinventory items in the storage container, and quantity of the one ormore inventory items in the storage container; automatically orderinginventory items wherein a percentage of a particular inventory itemlocated in the storage container drops below a predetermined percentage;and receiving a BMI in a user profile and altering or decreasing a rateof the automatically ordering of the particular inventory item of theone or more inventory items based upon the BMI.